AN ALGEBRAIC PROPERTY OF HECKE OPERATORS AND TWO 

INDEFINITE THETA SERIES 

VICENTIU PASOL, ALEXANDRU A. POPA 

Abstract. We prove an algebraic property of the elements denning Hecke operators on period 
polynomials associated with modular forms, which implies that the pairing on period polynomials 
corresponding to the Petersson scalar product of modular forms is Hecke equivariant. As a conse- 
quence of this proof, we derive two indefinite theta series identities which can be seen as analogues 
of Jacobi's formula for the theta series associated with the sum of four squares. 



1. Introduction 

The action of Hecke operators on period polynomials for the full modular group has been 
defined algebraically by Choie and Zagier [CZ93] (see also [Za93j). To describe their construction, 
let M n be the set of integer matrices of determinant n, modulo ±7, and let R n = Q[M n ]. Thus 
Ti = PSL 2 (Z) acts on R n by left and right multiplication. Let M%° = { (g \) : n = ad,0 ^ b < d] 
be the usual system of representatives for ri\M n , and T£° = X^MeM°° M £ R n . Then there exist 

T n ,Y n G R n such that 

(1.1) T™{l-S) = {\-S)T n + {l-T)Y n 

where S = ( ° ~jf ) anc ^ ^ = (oi) are ^ ne standard generators of T\. Any such element T n gives the 
action of Hecke operators on period polynomials of cusp forms for the full modular group [CZ93]. In 
[PP12| we show that the same elements have actions on (multiple) period polynomials of modular 
forms for finite index subgroups V of T%, corresponding to actions of a wide class of double coset 
operators S n C M n on modular forms. Remarkably the elements T n are universal, not depending 
on T or the double coset S n . 

Elements T n satisfying condition (jl.ip go back to work of Manin [Ma73] . The element T n is 
unique, up to addition of any element in the right Ti-module 

(1.2) 1= (l + S)R n + (l + U + U 2 )R n , 

where U = TS has order 3. Examples of such T n are given in [CZ93. Za90]. Another example will 
be given in an upcoming article of the second author and Don Zagier, leading to a simple proof of 
the Eichler-Selberg trace formula for modular forms on T\ (N) with Nebentypus, which generalizes 
the approach sketched in |Za93j for Ti. 

In the context of modular symbols, Merel gives many examples of elements T n £ R n giving the 
action of Hecke operators on modular symbols, which satisfy a condition similar to (jl.ip [Me94] . 
It can be shown that their adjoints T n = satisfy (jl.ip . where for g E M n we denote by g y = 
g^ 1 det g the adjoint of g, and we apply this notation to all elements of R n by linearity. 

The space of period polynomials is endowed with a pairing corresponding to the Petersson 
scalar product of modular forms via a generalization of a formula of Haberland. We show in |PP12| 
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that the Hecke equivariance of this pairing under the action of T n is implied by the following 
algebraic property of the elements T n . 

Theorem 1. For any element T n E R n satisfying property (II. ip we have 

(1.3) TniT-T-^ + iT- 1 -T)fv + 

The rest of the paper is devoted to an algebraic proof of the theorem, along the way obtaining 
other properties of the elements defining Hecke operators, which may be of independent interest. 
An unexpected outcome of this algebraic approach is the discovery of the following "indefinite theta 
series" identities, which are proved in Section [3l 

(1.4) ^ + 4^ aq ad = 3E 2 ( q ) + ^2 q n2 , 

a,b,c,d^0 d^a>0 n>0 

a+b>\d~c\, c+d>\a-b\ 

(1.5) Y! q x2+z2 - y2 ~ t2 +2^(x- \y\)q x2 - y2 = E 2 (q) - 2E 2 (q 2 ) + 4E 2 (q 4 ) + £ q n \ 

x^\y\,z^\t\ x>\y\ n>0 

x>\t\,z>\y\ 

where E 2 (q) = J2 n >o a ^( n )l n * s * ne we ight 2 Eisenstein series without the constant term, and the 
notation indicates that the terms for which there is equality in the range are summed with 
weight 1/2. For example, when p is an odd prime, we obtain that p — 3 is the number of integer 
solutions of 

x 2 + z 2 — y 2 — t 2 = p, with x, z > \y\, \t\. 
This can be seen as an indefinite analogue of Jacobi's result on the number of ways of representing 
a positive integer as a sum of four squares. It would be interesting to fit these examples into a 
theory of theta series for indefinite quadratic forms, of the type developed by Zwegers [Zw02] for 
forms of signature (r, 1). 

The proof is organized as follows. In $2] we derive a characterization of I + I V that allows us 
to reduce fll .3 jl to a relation involving only . This relation is then shown to be equivalent to two 
relations possessing an extra symmetry besides invariance under taking adjoint, which are proved 
in The main part of the proof is contained in ^3l where we also derive the indefinite theta series 
identities as immediate corollaries. 

2. Preliminary reductions 

First we prove a characterization of the set I + X v , based on a similar characterization of I in 
[CZ93] , 

Proposition 2. Let A G R n = Q[M n ]. Then A£l + l v if and only if 

(1 - S)A(1 - S) e (1 - T)R n (l - S) + (1 - 5)^(1 - T- 1 ). 

Proof. The proof is based on the characterization of X in [CZ93, Lemma 3]: 

(2.1) v e 1 <=> (1 - S)v E (1 - T)R n . 

We need a more precise version, which appears in the proof of Lemma 3 in [CZ93 : 

Lemma 3 QCZ93] ). Let A,B £ R n such that (1 - S)A = (1 - T)B. Then there exists C £ R n 
such that 

A = (1 + S)C - SB, with SB E (1 + U + U 2 )R n . 
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If A E X + X v , the claim of Proposition [2] follows immediately from (|2.ip and its adjoint. 
Assume therefore that A E R n satisfies: 

(1 - S)A(1 - S) = (1 - T)a(l - S) + (1 - 5)/3(l - X" 1 ) 

By the adjoint of the relations in Lemma [3] it follows that there exists C E R n such that 

(2.2) (1 - S)A = (1 - X)a + C(l + 5) + (1 - S^S, 

with (1 - E + U + U 2 ). Since (1 ± S) 2 = 2(1 ± 5), multiplying fl£2J by 2 we get 

(1 - 5) • 2A = (1 - T) • 2a + C(l + 5)(1 + 5) + (1 - 5)(1 - 5)/35 
From (J22]) we can write C(l + S) = (1 - 5)7 + (1 - X)<5, therefore: 

(1 - 5)[2A - 7(1 + S) - (1 - S)/3S] E (1 - X)i? n . 

By (|2.ip we conclude 

2^4 — 7(1 + S) — (1 — S)/3S E X. 
Since (I-S)PS E ^(l + CZ + f/ 2 ), it follows by dividing the last equation by 2 that A E X+X v . □ 

Corollary 4. Le£ J = (1 — T)R n (l — S) C i? n . X/ien (|1.3p is equivalent to the statement 

(2.3) T^ST-^l - 5) + (1 - S)TST%° V e J + J v . 

We remark that T^° J 4(1 — S) (mod J7) is well-defined modulo multiplication by powers of X on the 
left, for any i £ Ti, so we can take in (12.3P 



(2-4) = £ E where t M (6) = (jj 

n=ad b (mod d) 

Proof. By Proposition [2] and (jl.ip . (|1 .3|) is equivalent to the following statement: 

2£°(1 - S)(T - T- X )(l - S) + (1 - 5)(T- X - T)(l - S)X^° V E J + J v . 

By the remark above, we have T£°(l — T)(l — S) E J, so that: 

T~(l - 5)(T - T" 1 )(l - 5) = T^S{T~ l - X)(l - 5) 

= T™{ST- 1 + T- X ST- X ){1 - S) 
= 2T™ ST' 1 ( 1 - 5) (mod jf) 

On the second line we used STS = X -1 SX _1 , and on the third the remark above. □ 

We need the following notation. Let e = ("q 1 1) an d for m E M n denote mf = erne. For any 
matrix m E M n we denote by m* E i? n the following linear combination of eight matrices: 



(2.5) m* = (m - m'){\ - S) + (1 - S)(m 



V /V-i 

m 



and extend this notation to elements of R n by linearity. Note that m N = m v/ . 

In the next proposition we show that (|2.3p is equivalent with more symmetric relations, involv- 
ing only terms of type m*. The latter will be proved in the next section, using only the following 
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easily checked properties: 

(PI) m* + (m /v )* + (SmSy + (Sm' v S)* = 

(P2) {m'f = -m* 

(P3) (mSy = —m* 

(P4) (T k m)* = m* (mod J + J v ) for any integer fc. 

Proposition 5. W^e /iaue i/ie following congruences (mod + ,y v ).' 

(2-6) E [ E - Kl)(a% a/2)\ = 4 [^C/ 2 (l - S) + (1 - S)C/T-V] 



n=ad —d—^<k<d- „ 



->ooVl 



(2-7) E [ 2 E (-*^*)+*(§)(«/ 2 .^)] =2[T-C/ 2 (l-S) + (l-5)^ 

n=ad ° </: < tj ~" 

where 5(x) is 1 if x £ Z and otherwise. 

The LHS of ([IS]) is congruent to 2(T,f£/ 2 )*, while the LHS of (J2ZZD is congruent with (UT^U 2 )*, 
but we will not need these facts in the sequel. 

Proof. The summand in the LHS of ([23]) is (t a ,d(-k - a)ST- 1 )* [with t M (fr) defined in ([23])], and 
we note that k is well-defined modulo d by (IP4I) . We can rewrite the LHS as follows: 

E E 2(M*)^Y-*(f)[(^°f) + (.Ja^)r = 2(2«>Sr-i)* 

n=ad k mod ci 

because the sum of the terms in square brackets equals 

E [(- B <3) + (2-?)]* = o 

ra=2ctc( 

(exchanging a with d in the first matrix and using (]P2p ). 

For any A G ii n , we use the abbreviation {^4} + {adj} := A + A y . We have 

(T^ST- 1 )* = {[T^ST- 1 - (!%>)' ST\(1 - 5)} + {adj} 

(2.8) = {[T-5T- 1 + (T™)STS](1 - S)} + {adj} 

^{2T n 00 5T- 1 (l-S)}+{adj}, 

proving (|2ISD • On the second line we have used that (r~)'A(l-5) = 2£°.A(l-£) for any A G Ti(Z), 
by the remark following Corollary [U while on the third we used (5T) 3 = 1 together with the fact 
that T~T _1 (1 - 5) = T~(l - S) (mod J), by the same remark. 

The summand in (|2.7p is (S ta^tyST^ 1 )* , and we have as in fj2 . 8|> : 

(St^iQST- 1 )* = {(St^ST- 1 + St a4 (-k - a)ST- l ){\ - S)} + {adj}. 

The range — < k < is invariant under k ^ —k — a, hence the LHS of (j2.7|) . which we 
denote L n , becomes: 

(2.9) L n =Y,{ 2 E St M (fc)5T- 1 (l-5)} + {adj}. 

n=ad a+d ^j,, ^ d-q 

Now we have: 

(2.10) St^ST-^l -S)= taMST-^l -S) + (l- S)[t a Ja + k) - t a Ak)]S. 
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Since t a ^{k)ST~ l {l — S) (mod J) depends only on fc(mod d) we have: 

k<^ d-1 

(2.11) M*)^ 1 " S ) = E taAk)U 2 (l -S)- 6{^) t a4 {^)U 2 (l - S). 

-B±d <k k=0 

Similarly 

Ma + k)- t a4 (k)](S - 1) = S(^)[t a>d (^) - t a>i {z=±)] (S - 1) 



-!T<* 



2 

Next we observe that 



(2.i2) E {WW-U^^ + HbEf E [M*0- M° + *0]+ 

n=ad a+d n=ad a + d 

k<^ 

+ E t v(-*o - M-<* - fc)]] = E ^) - M^)] • 

a + d n=ad 

Notice that (|2. 12[) can be conjugated by S, since 5 V = S. Putting together the resulting equation, 
and flg3SD , (MD , pTTO]) . (12^1) . we obtain: 

L n ee {2T-ST- 1 (1 - 5)} + {adj} + 2 ^ 5(^)£ M 

n=ad 

where: 

+ { [ W(^) " W(^)] ( S ~ !) - W(^)^ 2 (l " 5)} + {adj}. 
It is easy to see that + £?d,a = (mod + J' v ), finishing the proof of (|2.7p . □ 

3. Main algebraic result and a theta series identity 

In this section, we finish the proof of (|1.3p . The indefinite theta series identities from the 
introduction follow as a bonus from the proof, and since they are of independent interest we keep 
this section self-contained. 

Recall the notation (|2.5p and properties (|Pip - (|P4p . which are the only ingredients needed. For 
convenience we rewrite the four-term relation: 

(pi) (^)*+(^r+(r/)*+«ir)*=o- 

We will apply this relation to matrices in the following set 

S n = {(«-&) eM n :0&; d^a; a + 6>d-c>o}. 
More precisely, for each 7 = (« denote A 7 = { (° " b ) , { d c ~ a b ) , ( g " c ) , (jj ~ c ) } and define 
(3.1) T„:= |J ^ 7 = |("^ fe ): 6 + c>|a-d|, max(a, d) > max(6, c)| 
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(the union is disjoint), so that we have by construction 

(3.2) ]T 7 * = 0. 

76T„ 

It is convenient to further symmetrize the set T n by interchanging a o b, c o d. Note that if 
a, 6, c, d satisfy max(a, d) ^ max(6, c) then 

b + c > \a — d\ c + d > \a — b\, a + b>\c — d\. 

Defining therefore 

(3.3) X n := { ( a c - d b ) : c + d> \a - b\, a + b > \c - d\} 

Vn := { (c ~d) £ Xn : max (M) = max(6,c)|, 

we have the disjoint union X n = U n U V n . By ()P2|) . (|P3p . (j3.2|) we have X^eWn 7* = 0> an d ft is 
easily found that 

(3.4) V n = |J ^4 7 over 7 = ( « ~ 6 ) with c|n, O a ^ - - c 

7 

so that ^ 7g v n 7* = 0. Consequently 

(3.5) £ 7* = 0. 

Proposition 6. For every n > we have the congruence (mod J + v7 v ); 

(3-6) E7*=E[ E E (^)]* 

7GAf n n=ad -d-^<k<d-^ -a <k< d^a 

By Proposition [5] and ()P2p . we obtain 

= £ 7* = -6 [T n °°?7 2 (l - S) + (1 - 5)^T n °° v ] (mod J + J y ), 

which, together with Corollary [J finishes the proof of Theorem [TJ 

Before proving the proposition, we show that it implies the theta series identity ()1.4|) . For a 
set of 2 by 2 matrices A denote by M(A) the number of matrices ( * * d ) 6 A with cd > 0, minus the 
number of matrices with cd < 0, namely: 

M{A) = £sgn(c 7 d 7 ). 

7<=A 

Corollary 7. We have the identity: 



(3.7) y! i ad+bc = SE *w - 2 E <W n ) 9 n + E ^ n2 ' 

a+fe>|d— c|, c+ci>|a- 

w/iere cr min (n) = ^2 n=ad min(a, d). 



a,&,c,d>0 n>0 n>0 

a+6>|d— c|, c+cf>|a-fe| 
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Proof. We claim that J\f{X n ) equals the coefficient of q n in the LHS of (I3.7P : on the other hand, 
going from f|3 . 5f) to (|3.6p we use only relations (|P2j) - (|P4p . which do not change the function Af, so 
N(X n ) can be computed exactly from the RHS of (13. 6ft . yielding the coefficient of q n in the RHS 
of (13. 7f) . and the proof is finished. 

To count M{Xn)i we start with T n - Let 7 = { a c ~ d b ) G S n . Clearly c, d > and we have three 
cases: 

(1) a > > 6 or b > > a. Then AA(^ 7 ) = 0; 

(2) a,b > 0. Then AA(^ 7 ) = |Ay|; 

(3) One of a, b is 0. Then the other is positive and Af(A^) = ^\Aj\. 

By (|3.ip we conclude that M{T n ) = #{ { a c ~^) G 7^ : a,b,c,d ^ 0}, each matrix with o6cd = 
being counted with weight 1/2. The same is obviously true for U n , and by inspection for V n (see 
flMD). We conclude that 

(3.8) = #{(-) 6 * ; M,o,o 0; — ^tSSi™ }• 

that is M{X n ) is the coefficient of q n in the LHS of (13. 7p . as claimed. □ 
Proof of Proposition We decompose A^ as a disjoint union: 

X n = U X~ U A^ - 

where X=, and <Y> consist of those 7 = { a c ~ d h ) G with |c| < d, c = d, and c > |d| 
respectively. Using (|P2p - (|P4p . we will show that X^eA^ 7* reduces to (j3.6f) . 
If f^j e A^, we have n = ad, x = a + k and 2d > \a + 2k\, hence 

(3-9) £7*=E E (^5)*- 

n=ad —d—%<k<d—% 

Since m — > m'S takes X< bijectively onto X> , we have by fjP2[) . (|P3p 

(3.10) E = E 

It remains to calculate Ylyex < 7*- 

For m G M n , denote by {m} the equivalence class of m in X< modulo multiplication by powers 
of T on the left, namely {m} := ri^m n X< where Tioo = {T k : k G Z}. Consider the involution 

f :T loo \X< ^T loo \X<, f({m}) = {m'}. 

We show that / is bijective, and the classes {m}, m £ X n have one or two elements. Let m = 
(c~d) eX n, an d let T^m' = ( £ ~zf ) • Th en 



T^m' G X n fc > 1 h ' 



d 



< 1. 



c + d 1 

Since c + d > \b — a\, a + b > d — c > 0, it is clear that there exist one or two values of k for which 
T~ k m' G X n , and therefore / is bijective (since it is an involution). Moreover, 



(3.11) \{m'}\ 



1 iid-c\a + b {k = §±|); 

1 if d-cfa + fr, 6 ^ a, < 2 (k = 2) 

2 otherwise . 
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Since d-c\a + b ^> A = B, and a = b ^> D-C\A + B, and b > a, §*£ < 2 B > A, < 2, 
there are four possibilities: 

(1) d-c\a + b, a^b^D-C\A + B,A^B. Then \{m}\ = \{m'}\. 

(2) d - c|a + 6, a = 6 <=^- D - C\A + B, A = B. Then \{m}\ = \{m'}\ = 1. 

(3) d - c \ a + b, a = b D - C\A + B,A^B. Then 

fl if^<2 



2 if^>2 



|{m}| = 1, \{m'}\ 
(4) d - c\a + b, a^b D - C f A + B,A = B. Then 

|{m'}| = 1, |W| = 



1 if < 2 

2 if^±§>2 



Summing over two copies of X< divided into classes {m} and respectively {m'}, everything cancels 
by (|P2|) except for matrices m' in case (3) with > 2, and matrices m in case (4) for which 
jyz^ > 2. The two sums are equal and we obtain 

2 £ 7* = 2^ 7 *, over 7 = (_ a c S),d>|c|,d-ct2a,^->2. 

76*< 7 

Writing n = ar, so that c + d = r, we obtain (after substituting — c for c ) 

^g^< ra=ar 0<r+2c<a 

r+2c|2a 

By (|3.9p . (|3.10p . the proof of (|3.6p is finished once we show that the same sum, but with the 
congruence condition replaced by r + 2c|2a, yields (mod J + J y ). By (|P2p . (]P4p . it is enough to 
show that 

( a c dr) = ( a 'l^ ~ a 't^.' +r/) ) ^ r + 2c|2a, r' + 2c'|2a', 
where n = ar = a'r' , i £ Z, and < r + 2c < a, < r' + 2c' < a'. Indeed the equality of the 

2a 2a' 
r+2c r'+2c' 

□ 



matrices implies t = = zrrkp , proving the equivalence above. 



We end this section with a proof of (jl.5p , which is entirely similar to that of Corollary [7J Let 
S' n , ■ ■ ■ , X' n be the sets defined like S n , ■ ■ ■ ,X n but with the extra parity conditions a = d (mod 2), 
b = c (mod 2). 

Proposition 8. a) If n is odd then 

(3.i2) E^-E 2 E (iaUT- 

7 eA^ n=ad _a <k< d^a 

b) If n is even then 

(3-13) £t*=£ E (•?!)*+£ 2 E (*^f- 



n=ad — d— %<k<d-% n=ad a <]• i d ~ a 

2 I» fei(mod2) 2 2|a,2|rf ^<^< 2 
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Proof. The proof is very similar to that of Proposition El and we prove only part a) leaving b) as 
an exercise for the reader. Assuming n odd and referring to the proof of Proposition El the parity 
condition implies that a ^ b, c ^ d (mod 2), so that X'= is empty, and only cases (1) and (4) can 
occur for m G X^~. The integer k such that T~ k m' G X^ must be even, so in case (1) we have 
\{m}\ = \{m'}\ = 1, while in case (4) we have |{m'}| = 0, because ^| is odd in that case. Denoting 

by Xn^ the set of m = { a c ~^) G X^, with d > \c\,d — c\a + b, it follows that 

E 7*= E ™* 

Writing d — c = r > 0, a + 6 = Zr, from a(d — c) + c(a + 6) = n we have that n = rs with s£Z and 
a + Zc = s, so T'm = ( s c c + r ). The condition m G A^- implies that 

2s 



I > 1,1 odd, and 



2c + r 

2* 



< 1, 



so there is a unique such m for each c > -j 1 such that > 2, and 2c + r \ 2s. Consequently: 

E^E E (c C ^r- 

2c+rf2s 

The proof is finished by observing that the divisibility condition can be removed, exactly as in the 
previous case. □ 

Corollary 9. We have the identity 

(3.14) Yl q x2+z2 ~ y2 - t2 = E 2 (q) - 2E 2 (q 2 ) + 4£ 2 (< ? 4 ) - 2 £ < in (n) q n + E ^ 

Xlt\v\,z^\t\ n>0 n>0 

x>|t|,z>|2/| 

w/iere < v in (n) = E n =od,2| (d-a) min(M)- 

Proof. Arguing as before, we have that M{Xl n ) is given by f|3.8j) with Af n replaced by A^. Making 
a substitution a = x + y,d = x — y,b = z + t,c = z — t, the conditions a,b,c,d ^ become x ^ |y| , 
z ^ \t\, while a + 6 > |c — d|,c + d > \a — 6| become x > \t\,z > \y\. Therefore Af(X^) is the 
coefficient of q n in the LHS of (J3J3]). 

As before, we can count N(X' n ) from Proposition El When n is odd, (|3.12)) gives 

M{X' n ) = a{n) - 2cx min (n) + 8(y/n). 

If n is even, f)3. 13|) yields (the first term comes from the first sum, and the second from the second 
sum) 

N(X' n ) = [aft) -r(f)] + [2a{D +r(f) - 2< in (n) + 5(^)] , 
where r(n) is the number of divisors of n and we adopt the convention that an arithmetic function 
is zero on non- integers. This is exactly the coefficient of q n in the RHS of (I3.14p □ 

The relations in £[3] have been checked numerically for small n using MAGMA |Mgm| . 
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